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Abstract 

We extend the results of [14, 27, 29] about the convergence of nearly unstable AR(p) 
processes to the infinite order case. To do so, we proceed as in [19, 20] by using limit 
theorems for some well chosen geometric sums. We prove that when the coefficients 
sequence has a light tail, nearly unstable AR(oo) processes behave as Ornstein-Uhlenbeck 
models. However, in the heavy tail case, we show that fractional diffusions arise as limiting 
laws for such processes. 
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1 Introduction 

In the field of time series analysis, autoregressive processes (AR processes for short) probably 
represent the most classical class of models. In this work, a discrete time process y is said to 
be autoregressive if it satisfies yo = eo and for A; > 1, 

k 

Uk “b ^ ^ ^iVk—i: 
i=l 

where i;f) is a sequence of non-negative coefficients and the are iid centered random vari¬ 
ables with finite second order moment. The process is called AR(oo) if an infinite number of 
coefficients are non-zero and AR(p) if they are all equal to zero after rank p. A first reason 
for the popularity of AR processes is the fact that they are quite tractable. Furthermore, it 
is usually easy to give an interpretation for such dynamics in practice. That is why they are 
nsed in various fields such as population dynamics, see [14, 28], finance, see [17], or telecom¬ 
munications, see [1]^. 


^Of course the references given here are just some examples among many others. 
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For classical AR processes starting at —oo and with non-negative coefficients, it is well known 
that a necessary condition for the existence of a stationary solution is 

+00 

( 1 ) 

i=l 

Thus, (1) is called stability condition. However, in many applications, notably finance, the 
case where this stability condition is almost saturated: 

- 1-00 

0 < 1 - ^ < 1 

i=l 

seems to be relevant, see [14, 24]. 

To address this near instability situation, several authors have considered the framework of 
sequences of AR(1) processes of the form 

Vk = PnUk-l + 

with the autoregression parameter pn tending to one as n goes to infinity, see for example 
[14, 25, 27]. In these works, it is shown that after suitable renormalization, such processes 
asymptotically behave as Ornstein-Uhlenbeck models. The estimation of the AR coefficient 
has also been extensively studied in such an asymptotic, see [9, 11] and [7, 10, 12] for more 
recent related developments. The situation where the number of coefficients in the autore¬ 
gressive process is larger than one is treated in [8, 21, 29]. However, to our knowledge, no 
result is available in the case of nearly unstable AR(oo) processes. The aim of this work is to 
fill this gap, using a methodology originally developed for Hawkes processes in [19, 20]. 

A Hawkes process (Nt) is a point process whose intensity at time t, denoted by Xt, is of the 
form ^ 

Xt = p+ s)dNs, 

J —OO 

with p a constant and (p a non-negative measurable function, see [18]. The linearity in the 
previous equation implies that Hawkes processes have a common structure with autoregres¬ 
sive processes. In particular, under the stability condition that the norm of p, denoted by 
is strictly smaller than one, Hawkes processes admit a stationary intensity. Let us also 
mention that the counterpart of the Yule-Walker equations linking the autocorrelations of an 
AR process to its coefficients is the Wiener-Hopf equation, see [4, 18]. 

In the recent papers [19, 20], nearly unstable Hawkes processes are introduced and their 
asymptotic behavior is investigated. Such processes are defined as Hawkes processes for 
which the stability condition is almost saturated: 1 — |(/>| 2 ,i <C 1. The key idea to understand 
the limiting laws of nearly unstable Hawkes processes is to relate their dynamics with some 
geometric sums whose parameter tends to zero. In this work, we follow the same strategy in 
order to derive asymptotic results for nearly unstable AR(oo) processes. 

We show that the limiting behavior of nearly unstable AR(oo) processes strongly depends on 
the properties of the sequence p = {pi, p 2 , ■ ■ ■)■ Two main situations have to be considered: 
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the light tail case, where (pi goes rapidly to zero (or is even equal to zero for i large enough) 
and the heavy tail case, where the decay of the sequence cp is slow. We prove that in the first 
situation, the cumulated process asymptotically behaves as an integrated Ornstein-Uhlenbeck 
model, in agreement with the results obtained in the literature for AR(p) processes. How¬ 
ever, in the heavy tail case, a fractional limit is obtained. More precisely, the renormalized 
cumulated AR(oo) process behaves as a kind of integrated fractional Brownian motion with 
Hurst parameter smaller than 1/2, or as a process close to a fractional Brownian motion with 
Hurst parameter larger than 1/2, depending on the decay rate of the sequence (p. 

The paper is organized as follows. In Section 2, we introduce the geometric sums and de¬ 
rive their limiting behavior as their parameter tends to zero. We describe our asymptotic 
framework in Section 3. Section 4 contains our main results about the limiting laws of nearly 
unstable AR(oo) processes and their proofs. We also interpret these results in terms of volatil¬ 
ity modeling in Section 5. Finally, some technical lemmas are relegated to an appendix. 

2 Geometric sums 

In this section, we consider the asymptotic behavior of some geometric sums. Understanding 
these sums is actually the key point in order to be able to derive limiting laws for nearly 
unstable AR(oo) processes. 

2.1 Geometric sums and convolution 

Let {an)n>i and {(pi)i>o be two sequences of non-negative numbers such that < 1, = 0 

and 

- 1-00 

= 1 - 

i=l 

In the next sections, will correspond to the sum of the autoregression coefficients and the 
(pi to the (fixed) shape of these coefficients, see Section 3. 

In this work, geometric sums, see [22], are random variables of the form 

= '^X\ 

i=\ 

where is a geometric random variable with parameter I —(with the convention = 0) 
and (X*) is a sequence of strictly positive integer-valued iid random variables such that for 
any i > I, 

=i] = (Pi. 

Now we dehne the sequence ip'^ by 


+ 00 

r = J2(^n(Pr\ 

1=0 

> 0, P[7" = i]= ai{l - a„). 
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with the sequence indexed by N such that = 1 and for i > 0, = 0 and for n > 0, 

^*(n+i) _ ^*n ^ where * denotes the convolution operator for sequences. Note that 


+ 00 




1 

1 Q-n 


Actually, the random variable and the sequence are closely related since for any i > 0, 

We will use the limiting behavior of E” to obtain asymptotic properties for the sequence ■0”', 
see Corollaries 2.1 and 2.2. This will provide us key results for our study of nearly unstable 
AR(oo) processes at large time scales. Indeed, in the next sections, for n tending to infinity, 
we consider on time intervals of the form [0, nt] autoregressive processes whose coefficients 
sequence can be written an4>- 

k 

Uk ~ Y '^^CLnfpiUk-ii 
i=l 

with Un tending to one (nearly unstable case). Then, it is easy to obtain the following moving 
average representation of the process: 



y'k 


k 


'^'Ipk-Yi 

i=0 


and in particular 


[ntj 

yfntj 


i=0 

Thanks to the previous representation, we see that the long term behavior of y” is linked 
with the asymptotic properties of the therefore with those of V^jn. Indeed, for 

example, for nt an integer. 


P[y^/n = t] 


^nt 


We now recall some results from [19, 20] which explain the two possible types of asymptotic 
behaviors for our geometric sums. Exhibiting one behavior or the other depends on the decay 
rate of the coefficients of (/>, that is on the tail of the distribution of . 


2.2 Light tail case 

The first asymptotic regime of interest is the one which occurs when the expectation of 
is hnite. Thus we consider the following assumption. 

Assumption 1. We have 

+00 

i(j)i = m < + 00 . 

i=l 

In that situation, the “appropriate” speed of convergence of towards one for the nearly 
unstable case is given in the next assumption. 
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Assumption 2. We have a„ < 1 and there exists A > 0 such that 


n(l — Qn) —>■ A. 

rx—>-+oo 

Indeed, recall Proposition 2.2 of [19]. 

Proposition 2.1. Under Assumptions 1 and 2, the random variable jn converges in law 
towards an exponential random variable with parameter A/m. 

Using Dini’s theorem, this implies the next corollary. 

Corollary 2.1. Under Assumptions 1 and 2, 


\nx\ 

sup I 
3:e[0,l] ^^0 


On) — (1 — e rn^)\ 


0 . 

Tl —>-+00 


2.3 Heavy tail case 

The second asymptotic regime of interest is the one which occurs when the tail of the distri¬ 
bution of is heavy. This can be formalized as follows. 

Assumption 3. There exists K > 0 and a S (0,1) such that 


+00 


i=N 


K 

N-y+oo ‘ 


Let us now write 

6 = Kr{l-a)/a, 

with r the Gamma function. In that heavy tail case, the “appropriate” convergence speed of 
On towards one is given in the next assumption. 

Assumption 4. We have a„ < 1 and there exists A > 0 such that 


ra“(l — On) —5- A(5. 

Tl —>-+00 

Indeed, recall Proposition 2.3 of [19]. 

Proposition 2.2. Under Assumptions 3 and 4, the random variable jn converges in law 
towards the random variable whose Laplace transform is 

A 

X + z°‘' 

It is explained in [19] that this random variable has the density 
where is the Mittag-Leffler function, see [26] for definition. 


Writing 


= f r’^{s)ds 

Jo 

and using Dini’s theorem, we have the following result. 
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Corollary 2.2. Under Assumptions 3 and 4, 


\nx\ 

sup - On) - 0. 

3 The asymptotic setting 

As previously explained, we consider a sequence of autoregressive processes of infinite order 
indexed by n. More precisely, Uq = eo and for any A: > 1, 

k 

i=\ 

where the are non-negative coefficients. We assume that the £k do not depend on n, are 
iid centered, and satisfy (for simplicity) 

E[(efc)2] = 1. 

We are interested in the long term behavior of the cumulative sums of such autoregressive 
processes when the stability condition (1) is almost saturated. To study this, somehow as in 
[19, 20], we consider that the “shape” of the coefficients sequence is fixed and that their 
norm On tends to one from below. More precisely, we take 


where 


H-oo 

= 1 


i=l 

and a„ —1 as n tends to infinity, with < 1. 

Since we want to investigate the asymptotic properties of cumulated sums of such processes, 
we introduce the suitably renormalized Donsker line for t S [0, Ij: 




I-ar 

y/n 


lnt\ 




j=0 


4 Main results 

4.1 The light tail case 

We give here the behavior of the Donsker line when the autoregression coefficients converge 
rapidly to zero. Note that the next theorem covers in particular the case of AR(p) processes 
already studied in the literature. 

Theorem 4.1. Under Assumptions 1 and 2, {Z'^) converges in law towards the process Z 
defined by 

Zt= [ (1= f ! — 

Jo Jo Jo m 

where W is a Brownian motion. 
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This theorem means that when observed on a time scale of order 1/(1 — a^), a cumulated 
nearly unstable AR(oo) process whose coefficients sequence has a light tail behaves as an 
integrated Ornstein-Uhlenbeck process. 


To show this result, the hrst step is to get the following proposition whose proof can be found 
in appendix. 

Proposition 4.1. Under Assumptions 1 and 2, the sequence (Z^) is tight. 

Then we need to prove the finite dimensional convergence. Using the moving average repre¬ 
sentation of the process, we derive 

[nt\ [nt\—i 

- «n)( ^ V’fc + {nt - + {nt - lnt\){l - 

i=o k=o 

This can be rewritten under the following integral form: 





\nt\ — [nsj 

+ {nt - [ref J +i_ ) dW^ + {nt - [nt \) (1 - a„) 

fc =0 


where 


it; 





k=0 


From Donsker theorem in Skorohod space, we have that converges in law towards a 
Brownian motion for the Skorohod topology. Furthermore, note that 


[nt\ — [nsj 

k=0 


belongs to 


[nt\ — [nsJ [nt\ +1 — \ns\ 

{I -an) V'L(l-On) 

k=0 k=0 


Thus, from Corollary 2.1, as a function of s, 


[nt\ — [nsJ 

(1 - ^ + (ref - LrefJ)V’f„,j+i_L„,j) 

k=0 


tends uniformly to 1 — e -md on [0,f]. Also, we obviously get that 

(ref - LrefJ)(l - an) 

y/n 

tends to zero. 
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Then, using Theorem 2.2 of [23] together with the fact that Skorohod convergence implies 
pointwise convergence at continuity points of the limit, for given t G [0,1], we get the conver¬ 
gence in law of towards 

(1 - 

With the help of Cramer-Wold device, it is easy to extend this result and to show that for 
any (ti, G [0,1]^, we have the convergence in law of ..., ) towards 



Together with the tightness of (Z”), this enables us to obtain the weak converges of (Z”) 
towards Z. 



4.2 The heavy tail case 

Let us now place ourselves under Assumption 3 which states that the coefficients sequence 
has a power law type behavior. Then, using the geometric sums interpretation, we see that 
the natural “observation scale” of the process is of order (1 — This corresponds to 

Assumption 4. We have the following result. 

Theorem 4.2. Under Assumptions 3 and 4, {Z^) converges in law towards the process Z 
defined by 

Zt= [ F^’\t-s)dWs, 

Jo 

where W is a Brownian motion. 

In Section 5, we will see that for a > 1/2, the limiting process can be viewed as an integrated 
rough fractional process, whereas for a < 1/2, it is close to a fractional Brownian motion 
with Hurst parameter larger than 1/2. 


To obtain Theorem 4.2, the same strategy as for the proof of Theorem 4.1 is used. In 
particular, the following proposition is proved in appendix. 

Proposition 4.2. Under Assumptions 3 and 4, the sequence (Z"") is tight. 

The end the proof of Theorem 4.2 follows as previously, using the decomposition 


Zt = [ (l-On)( XS '>Pk + {nt-[nt\)fi^^^^^^_^^^^'^dW^ + {nt-[nt\){l-an)- 

fc =0 


\nt\ — [nsj 


[ntJ+1 


the uniform convergence of 


\nt\ 

k={) 


towards F°‘’^{t) (see Corollary 2.2), and the convergence of Wfi towards a Brownian motion. 



5 Application to volatility modeling 

Let us now interpret Theorem 4.2 in terms of volatility modeling on financial markets. Con¬ 
sider that the log-volatility process is driven at discrete times by a nearly unstable autore¬ 
gressive process with heavy tailed coefficients sequence. We choose to model the log-volatility 
rather than the volatility itself because it is well established that it is better approximated by 
a linear autoregressive process than the volatility, see [2, 3, 13, 16]. Such model can reproduce 
the clustering property of the volatility at multiple time scales. 


5.1 The case a > 1/2 

When a > 1/2, applying the stochastic Fubini’s theorem, see 
process for the cumulated sums, Z, can be rewritten 


we get that the limiting 


r r r’\s-u)dWuds. 

Jo Jo 


Z, = 


Therefore, in that case, it is differentiable and its derivative 


Yt = 


f r’\t-u)dWu 
Jo 


locally behaves as a fractional diffusion with Hurst parameter H = a — 1/2. Indeed, 

r’\x) ~ c/x^-^ 

when X is close to zero and recall that a fractional Brownian motion can be written as 

1 1 


Wf = 


/ 

J —( 




dW.. 


In particular, proceeding as in [20], we get that for any e > 0, Y has Holder regularity 

a — 1/2 — e. 


Thus, in this regime, the log-volatility asymptotically behaves as a fractional Brownian motion 
with Hurst parameter a — \l‘l. According to [16], this is consistent with empirical measures 
of the smoothness of the volatility process provided that a ~ 0.6. 


5.2 The case a < 1/2 

When a < 1/2, the behavior of Z is quite different. Proceeding as in [20], we get that for any 
£> 0, Z has Holder regularity 1/2 -|- a — e. This is not very surprising since the situation 
a < 1/2 is close to that of ARFIMA processes^, which are known to behave as a fractional 
Brownian motion with Hurst parameter 1/2 -|-a at large time scales, see [15]. In this regime, 
the log-volatility exhibits apparent long memory, as observed for example in [2]. 

®An ARFIMA process, see [5], can be written as an infinite order autoregressive process whose sum of 
the coefficients is equal to one and whose coefficients sequence </> asymptotically behaves as (j)i ~ with 

0 < a < 1/2. 
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5.3 The case a = 1/2 

In the critical regime a = 1/2, we somehow asymptotically retrieve some features of the 
multifractal model of [3]. Indeed, in [3], the “log-volatility” is written under the form 


= [ ki^T{t - s)dWs, 

J —OO 


where IT is a Brownian motion and ki x is function behaving in the range ^ <C t <C T as 

for some model parameters I and T. Therefore, the integrated log-volatility defined as 


satisfies 


with 


n 


= / Ull^T{s)ds 

Jo 

I,Tit) = f {Ki^xit -s)- Ki-s))dWs, 

J —OO 


Ki^rit) = It>o [ ki^Tis)ds. 

Jo 

This behaves as K^y/i in the range I t ^ T. 

Thus, this “multifractal” regime (a = 1/2) appears as the interface between the classical 
long memory (log-)volatility models [a < 1/2) and the more recent rough volatility models 
(a > 1/2). 


A Appendix 

In the sequel, c denotes a positive constant which may vary from line to line. 

A.l Proof of Proposition 4.1 

In this paragraph, we place ourselves under Assumptions 1 and 2. Before proving Proposition 
4.1, we need a technical lemma. 

Lemma A.l. There exists c > 0 such that for any n, k, k', 

nvivi'] < T^- 

1 dyi 

Proof. For any fc, using the moving average representation of the process, since 6 is a white 
noise, we get 

k +00 

E[{a”)"l = 

j=0 j=0 
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Moreover, using Parseval’s Theorem‘s, 

+ CX) 


+0O .1/2 

= 2 / \r{z)fdz 
j=o do 


fl/2 1 

< 2 / -- ^dz, 

Jr, l-Onr 


where we have used that 


1 


fc >0 


|1 - an4>{z)\ 


< = 


1- a. 


□ 


Let us now prove Proposition 4.1. 


The result follows from an application of Kolmogorov’s criterion, see [6]. We show here that 
there exists c > 0 such that for any n, s and t, 

E[|Zf-Z”|2] <c|t-sp. 

We begin with the case where [ntj = [nsj. Using Lemma A.l, 

E[|Z,“ - Z."|2] = lL^„2|t_a|2E[(!,[‘„y^,)2] 

< cn(l — an)\t — 

Using Assumption 2, this ends the proof for [ntj = [nsj. 


In the case 


[nt\ = 

E[|Zr 


[nsj + 1, 

-Z2\^] < c(E[|Zr-Z[;ij/j2]+E[|ZpL„,j+i)/„-Zr|2]) 

< c|t-sp + -L^^(l-ns+ 

< c|t — sp +ns)^ 

< c\t — sp. 


We now treat the case where t = k^/n and s = /n, where k^ and k^ are integers so that 

k^ > k^. Using again Lemma A.l together with Assumption 2, we have 


E||zr - Z,"p] = 2—^ ^ EK* 


n 


ki=k^+l k2=k^-\-l 


< - k-f " 


n 


l-ar. 

k^ -k^\^ 


< c(l — an)ny - j < c\t — s 


'^In this work, the Fourier transform of a sequence {f„) is defined for ^ £ [—1/2,1/2] as f{z) = 

E f , „-2TTikz 


11 













Finally, for any t > s so that [nt\ > [nsj + 2, we use the decomposition 



The tightness follows. 

A.2 Proof of Proposition 4.2 

In this paragraph, we place ourselves under Assumptions 3 and 4. Before proving Proposition 
4.2, we need some technical results. 

Lemma A.2. There exists c > 0 such that for any \z\ < 1/2, 


1 — 4>{z)\ > c\z 


Proof. Since Assumption 3 is satished, there exists c' / 0 and d > 0 such that 


1 — (j){z) ~ c'z" 


and 


V|z| <5, |1 — (j){z)\ > |c'||z|"/2. 


On [(5,1/2], z \1 — (/( 2 :)|/| 2 :|“ is continuous and therefore has a minimum attained in some 


zq : |1 - 4>{zo)\/\zq\°‘ = M. 


M is strictly positive since Re((/)( 2 :o)) = E[cos(27r2;oA^)], which is strictly smaller than one 
because, using Assumption 3, zqX^ does not almost surely belong to N. 


Taking c = min(|c'|/2, M) ends the proof. 

Lemma A.3. For a > 112, there exists c > 0 such that for any n, k, k' 


□ 




Proof. As before, we have 



Therefore, for n large enough, > 1/2 and 


1 - an^{z)\‘^ = |1 - On + an{l - > |1 “ + 



Using Lemma A.2, this implies that 



Therefore, 



which ends the proof. 


□ 
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Lemma A.4. For a < 1/2, there exists c > 0 such that for any n, k, k' 


nvivi'] < 


c(l — a„)^“ ^ if k = k' 
c\k-k'^-^ ifk^k'. 


Proof. The fact that 

n{yk?]<c{i-anf--^ 

is a direct consequence of the proof of Lemma A.3 together with the inequality 1 —2a > 2—1/a 
for a <1/2. 


To prove the other inequality, remark that using the moving average representation of the 
process, for k > k', we get 

k' +00 

j=0 j=0 


Therefore, using Parseval’s theorem together with Lemma A.2 and the fact that the xfj are 
non-negative, we obtain 


E[yM']<cRe(^ - 


1/2 ^2m\k-k'\z 


- an4>iz)\'^ 

Thus, using Abel’s theorem, we finally obtain 

mvk'] < 


dz I < cRe 


1/2 g27ri|fc-fc'|2 
I ~|2a 


dz I. 


\k-k'\ 


l-2a ■ 


□ 


Lemma A.5. For a = 1/2, for any e S (0,1), there exists c > 0 such that for any n, k, k', 

nykyk'\<^ c + c((l-a„)2|fc-fc'|)-" ifk^k'. 

Proof. Using the same proof as for Lemma A.3, we get 

E[(yfc)2] < c|log(l -an)|. 

The first inequality follows. We obtain the second inequality using that for k > k', 

'* 1/2 ^27ri\k—k'\z 


E[«,] < cRe(^ 


(1 - an)2 -h \z 


■dz 


(l-a„)^ 


< C / -- :^dz -t- cRe 

(1 - anP 

< c-h c|log((l - anf\k - k'\)\. 


1/2 ^2-n-i\k-k'\z 


dz 


(l-a„)2 


□ 
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Let us now prove Proposition 4.2. 

In the case where a > 1/2, the proof that 

is almost the same as in the light tail case replacing the use of Lemma A.l by that of Lemma 

A.3. 


The case a < 1/2 is slightly more complicated. We now show that 

E[|Zf< c\t-s\^+^, 

for some rj > 0. As before, we begin with the case where [nfj = [nsj. Using Lemma A.4 
together with Assnmption 4 and the fact that 1 — a(2a + 1) > 0, we get 

2i „l2Tu>U„.n \2i 


E[|zr-zri^] = 


n 


-n^\t - smivU+in 


- n ^l-a(2«+l) ^ 

< c|t - s|l+"(2«+l). 

Using the same arguments as for the light tail case, we get a similar bound for [nfj = [nsj +1. 

We now treat the case where t = /n and s = /n, where k^ and k^ are integers so that 

k* > k^. Using again Lemma A.4, we have 

2 k^ 

E[|zr - T"* E E nvivu 


n 


ki=k^-\-l k2=k^-\-l 


This is smaller than (with obvious notation) 

+<:* E '€ ik‘ + 1, k ‘],- fei = Afc}). 

^ Afe=l ^ ’ 

Therefore, using Assumption 4, we get 


nzt-z'. 


n\2^ 


< 


(1 — / c{k^ — k^) 




n 


Afc=l ^ ’ 


< 


(1 - a.)i-2« (Afc) 

< c((f-s)^+“+2“' + (t-s)l+2“). 

The result for any s and t in [0,1] is obtained as in the light tail case. 

Finally, the proof for a = 1/2 is obtained the same way, using Lemma A.5 instead of Lemma 

A.4. 
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